Kernel Integration using von Neumann Entropy

نویسندگان

  • Andrea Malossini
  • Nicola Segata
  • Enrico Blanzieri
چکیده

Kernel methods provide a computational framework to integrate heterogeneous biological data from different sources for a wide range of learning algorithms by designing a kernel for each different information source and combining them in a unique kernel through simple mathematical operations. We develop here a novel technique for weighting kernels based on their von Neumann entropy. This permits to assess the kernel quality without using label information, and to integrate kernels before the beginning of the learning process. Moreover, we carry out a comparison with the unweighted kernel summation and a popular technique based on semi-definite programming on kernel integration benchmark data sets. Finally, we empirically study the variation of the performance of a support vector machine classifier considering pairs of kernels combined in different ratios, and we show how, surprisingly, the unweighted sum of kernels seems to lead to the same performance than a more complex weighting schema.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Valence bond and von Neumann entanglement entropy in Heisenberg ladders.

We present a direct comparison of the recently proposed valence bond entanglement entropy and the von Neumann entanglement entropy on spin-1/2 Heisenberg systems using quantum Monte Carlo and density-matrix renormalization group simulations. For one-dimensional chains we show that the valence bond entropy can be either less or greater than the von Neumann entropy; hence, it cannot provide a bou...

متن کامل

Perturbation theory of von Neumann Entropy

In quantum information theory, von Neumann entropy plays an important role. The entropies can be obtained analytically only for a few states. In continuous variable system, even evaluating entropy numerically is not an easy task since the dimension is infinite. We develop the perturbation theory systematically for calculating von Neumann entropy of non-degenerate systems as well as degenerate s...

متن کامل

Heat diffusion: thermodynamic depth complexity of networks.

In this paper we use the Birkhoff-von Neumann decomposition of the diffusion kernel to compute a polytopal measure of graph complexity. We decompose the diffusion kernel into a series of weighted Birkhoff combinations and compute the entropy associated with the weighting proportions (polytopal complexity). The maximum entropy Birkhoff combination can be expressed in terms of matrix permanents. ...

متن کامل

Various topological forms of Von Neumann regularity in Banach algebras

We study topological von Neumann regularity and principal von Neumann regularity of Banach algebras. Our main objective is comparing these two types of Banach algebras and some other known Banach algebras with one another. In particular, we show that the class of topologically von Neumann regular Banach algebras contains all $C^*$-algebras, group algebras of compact abelian groups and ...

متن کامل

Eigenvalue and Entropy Statistics for Products of Conjugate Random Quantum Channels

Using the graphical calculus and integration techniques introduced by the authors, we study the statistical properties of outputs of products of random quantum channels for entangled inputs. In particular, we revisit and generalize models of relevance for the recent counterexamples to the minimum output entropy additivity problems. Our main result is a classification of regimes for which the vo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009